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© Precision display position designation system using coarse touch panel input 



© A display includes circuitry for locating a cursor 
or similar position designation on a display which 
might, for example, represent a geographical area on 
a keyboard. A touch panel array of phototransistors 
and light emitting diodes provides a matrix of light 
beam paths across the face of the display or as a 
separate detection unit which are interrupted when a 
pointer such as a finger points to a particular loca- 
tion on the display and interrupts the light beams 
which is a coarse indication of a new cursor position. 
Initial transient position designation errors are elimi- 
nated by delaying until the array of light beams have 
been interrupted for several scan intervals at which 
time the fixed position is established or "jumped to"; 
^and terminating transient errors are eliminated by 
^deleting the last few position indications just prior to 
when the array of beams has remained uniterrupted 
£lfor several scan intervals. 
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PRECISION DISPLAY POSITION DESIGNATION SYSTEM USING COARSE TOUCH PANEL INPUT 



BACKGROUND OF THE INVENTION 



This invention relates to touch panel systems. 

It has previously been proposed to provide an 
interruptable array of light beams extending across 
a facepiate to designate display positions. Typical 
patents which show this type of system include 
U.S. Patent No. 3,764, 813, granted October 9, 
1973, U.S. Patent No. 3,775,560, granted Novem- 
ber 27, 1973 and U.S. Patent No. 4,198,623 grant- 
ed April 15, 1980. !n using such systems it is most 
convenient to use the finger or pointer to designate 
the desired display position with a display marker 
such as a video position designation marker, or 
cursor, which may for example be an X in a circle 
or the like. The finite thickness of a finger, how- 
ever, and coarse accuracy of the touch detection 
unit resulting from the spacing of the light beams, 
may mean that the video position designation 
marker is not positioned sufficiently accurately for 
some purposes. 

Accordingly, an important object of the present 
invention is to precisely locate a display marker 
such as a video position designation marker, or 
cursor, despite the use of a relatively coarse touch 
panel detection input. 

Another problem which occasionally interferes 
with the proper operation of touch panel displays is 
initial and termination transients. Thus, for example, 
touch initiation dynamics such as angled entry or a 
fly or other insect or a piece of clothing might 
partially interrupt one of the light beams, and this 
could provide a false location of the cursor. Simi- 
larly, at the end of the act of marking of the desired 
videc position on the display through the use of a 
person's finger, the finger might be withdrawn at an 
angle, and if this terminating transient carries over 
into the positioning of the video designation mark- 
er, or cursor, an error could be introduced. 

Accordingly, another object of the present in- 
vention is to avoid position errors which might be 
introduced by transients, often at the beginning or 
the end of marking a point on the display, or by 
inputs from the touch detection device such as 
random interruption of the light beams for an in- 
stant 



SUMMARY OF THE INVENTION 



In accordance with one aspect of the invention, 
the new position for the video position designation 



marker is determined not only by the location of a 
pointer indicating a spot on the display screen, but 
also by a velocity correction function (which may 
include an acceleration factor) involving the direc- 

5 tion and magnitude of the shift in position of the 
pointer between successive intervals of time. The 
invention to be described can be used with other 
types of displays such as arrays of lights, liquid 
crystal, plasma panel, arrays of lighted switches. 

io In accordance with another aspect of the inven- 

tion, input transients or momentary interruptions of 
the light beams, are eliminated by electronic cir- 
cuitry which delays shifting the position of the 
video designation marker until a predetermined plu- 

76 rality of scans indicates positive and steady in- 
terruption of the beams. Also, when the pointer is 
removed from the touch panel, instead of following 
to the last observed location of the pointer to 
position the cursor, which might be an erroneous 

20 path taken as the finger is lifted from the touch 
input device, the system selects a display position 
for the cursor based on a scan dating back from 
the final scan in which the touch input device was 
active. 

25 Viewed from another aspect, the invention in- 

volves precision cursor position from coarse input 
data by position determinations extending over 
several scan intervals, and avoidance of the in- 
troduction of false data at the transitions between 

30 the steady interrupted beam conditions and the 
uninterrupted beam state. 

It is also noted that the present invention is 
applicable to other types of fine and relatively 
coarse touch panel input devices, involving crossed 

35 wire or other switch elements or capacitive pads, 
as well as to light beam interrupting touch pad 
input circuits. Further, the input touch panel 
faceplate need not overlie the display screen but 
could, for example, be separately located, as long 

40 as the operator can see the movement of the 
cursor on the display resulting from the operator's 
positioning a pointer such as a finger. 

Advantages of the new system include the 
capability of very accurate display position des- 

45 ignations despite the availability of only relatively 
coarse position data as indicated by the location of 
a finger on the surface of the faceplate of the touch 
input device. In addition, false indications are 
avoided and accurate final positioning of the video 

so designation marker is possible, even when the fin- 
ger is inserted or removed at an acute angle rela- 
tive to the faceplate. In addition, the need for 
precisely aligning the touch panel with the display 
is eliminated, and paraliex problems or errors are 
also eliminated. 
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Another useful feature is the capability of 
"jumping" the cursor to a new position on the 
display upon initial touch activation by the pointer 
thereby eliminating the need to locate the cursor 
prior to designating a new position on the display 
and consequently increasing the speed of operator 
input. 

Other objects, features, and advantages of the 
invention will become apparent from a consider- 
ation of the following detailed description and from 
the accompanying drawings. 

BRIEF DESCRIPTION OF THE DRAWINGS 

FIG. 1 shows a display and. touch panel 
electronic unit of a type to which the present 
invention is applicable; 

FIG. 2 is a schematic block diagram of a 
display and touch panel system; 

FIG. 3 is a cross-sectional view through a 
cathode ray tube and a display enclosure indicating 
the physical configuration of a touch panel light 
beam system; 

FIG. 4 indicates how information is entered 
into the touch panel array through the use of a 
person's index finger touching the faceplate and 
interrupting an array of light beams; 

FIG. 5 is a schematic diagram showing a 
switching system for energizing or scanning the 
light beam paths which extend across the faceplate 
of a display; 

FIG. 6 is a block diagram indicating one type 
of microprocessor arrangement which may be em- 
ployed to implement the present invention; 

FIG. 7 is a block diagram indicating one type 
of hardware which may be employed to implement 
the invention; 

FIG. 8 is a sequence diagram showing tran- 
sient suppression techniques; and 

FIG. 9 shows a sequence diagram for pro- 
viding smooth cursor precision positioning data 
from relatively coarse input information from the 
touch panel. 

DETAILED DESCRIPTION OF THE INVENTION 



Referring more particularly to the drawings, 
FIG. 1 shows a display 12 mounted in a housing 
14, for the electronic system. Across the front of 
the display 12 is a faceplate, and beams of light 
are directed over the surface of this faceplate both 
horizontally and vertically, so that the coordinate 
location of a finger may be readily and consistently 
determined based on the interruption of the light 
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beams. 

FIG. 2 is a schematic block circuit diagram 
illustrating the principles of the invention on a 
broad level. More specifically, a display 22 is pro- 

s vided with an associated touch panel 24 which is 
only capable of providing relatively coarse posi- 
tional information relative to the size of a picture 
element of the video display 22 as will be ex- 
plained in more detail with reference to the other 

w FIGs. The touch panel data processor 26 deter- 
mines the location of a pointer such as a person's 
finger on the touch panel 24 as a result yclic 
scanning of the phototransistors and the light emit- 
ting diodes which make up the touch panel 24, and 

75 a sensing of the timed outputs from each of the 
phototransistors. Information as to the location of 
the person's finger on the touch panel is supplied 
from the touch panel data processor 26 to the 
display processor 28. Background display inforrna- 

20 tion is supplied from circuitry 30 to the display 
processor 28 to provide the desired background 
information such as a map, keyboard or the like 
upon which the video position designation marker 
is superimposed. An electronic system 32 is in- 

25 dicated schematically in FIG. 2, with interconnec- 
tions between the display processor 28 and the 
background display data source 30, because the 
touch panel and display system is often connected 
to a larger electronic system, which may one be of 

30 a large number of types of systems. 

FIG. 3 is a partial cross-sectional view which 
may be taken through the faceplate 12 and the 
housing 14 in a plane perpendicular to the 
faceplate 12 and extending along a horizontal line 

35 through the faceplate 12. In FIG. 3 a cathode ray 
tube 34 has its display surface close to the 
faceplate 12. As shown in FIGS. 3 and 4, a set of 
printed circuit boards 41 through 44 are located in 
the proximity of the front of the cathode ray tube 

40 34 and the faceplate 12. Each of these printed 
circuit boards are provided with either photo-emit- 
ters such as light emitting diodes 46, or 
photodetectors such as phototransistors 48. The 
light emitting diodes 46 provide beams of light 

45 such as infrared extending across in close proxim- 
ity to the faceplate 12. Individual light beams ex- 
tend from one light emitting diode 46 on one edge 
of the faceplate to a paired phototransistor 48 on 
the other edge of the faceplate. Switching circuits 

so enable successive pairs of light emitting diodes 46 
and phototransistors 48 sequentially, and the out- 
put from each phototransistor 48 is sequentially 
sampled. When no output is received from a par- 
ticular phototransistor 48 during the sampling pe- 

55 riod, this indicates that the light beam has been 
interrupted. The particular pair of light emitting 
diode 46 and phototransistor 48 may be identified 
by the sample timing of the enabling switching 



3 



BNSDOCID: <EP 0316972A2J_> 



5 



EP 0 316 972 A2 



6 



circuit as the scan sequentially proceeds across 
the faceplate. This may be accomplished either 
simultaneously or sequentially both relative to the 
horizontally extending beams of infrared light and 
with regard to the vertically extending beams of 
light. By locating the coordinate location of the 
finger touching the faceplate, both horizontally and 
vertically, through circuitry included in the touch 
panel data processor 26 (FIG. 2), suitable signals 
may be supplied to the display processor 28, and a 
display designation position marker, or cursor, may 
be positioned on the display by the display proces- 
sor 28. This could be in the form of a symbol such 
as a circle with an X across it positioned in full 
view just above the pointer, for example, as shown 
at reference numeral 50 in FIG. 1 and FIG. 4. 

FIG. 5 shows schematically the technique for 
scanning the light beams, or the pairs of light 
emitting diodes 46 and phototransistors 48 which 
are employed in the light beam scanning arrange- 
ments. More specifically, each light emitting diode 
46 has an enabling switch 52 associated with it, 
and each phototransistor 48 has an enabling switch 
54 connected to it. An address bus 56 extends 
from a signal processing circuit illustrated generally 
as a microprocessor 58 to the circuit boards 41 
through 44. It should of course be understood that 
a microprocessor 58 may not be used as such in 
lieu of counting logic and that it is illustrated for 
ease of understanding the operation of the circuit 
of FIG. 5 . The switches 52 and 54 are, of course, 
semiconductor switches and are energized sequen- 
tially according to the addresses supplied on the 
bus 56. Pairs of semiconductor switches 52 and 54 
associated with a single beam of light, have the 
same address, so they are enabled simultaneously, 
while none of the other LED switches or phototran- 
sistor switches are turned on during this interval for 
sequential operation. Scanning of the two emitter- 
detector arrays is accomplished by the application 
of a series of addresses on bus 56. In practice, a 
complete cycle of scanning is accomplished ap- 
proximately 30 times a second. The address in- 
formation supplied on bus 56 is correlated with the 
output signal information from the detector array 
indicating a pulse or no-pulse, from the common 
horizontal output pulse processor and amplifier cir- 
cuit 60 and from the corresponding vertical output 
pulse processor and amplifier circuit 62. The output 
pulse circuits 60 and 62 can be combined for 
sequential operation and can be the same as those 
disclosed in U.S. Patent Application Serial No. 
06/512,821 filed on July 11, 1983 by B. M. 
Komadina, V. D. Lazarevich and A. H. Beining. 

FIG. 6 is a block diagram which shows one 
arrangement for implementing touch panel data 
processor 26 functions described herein (a micro- 
processor implementation). Alternatively a hard 



wired logic could be used. In the FIG. 6 approach 
information from several touch panels may be sup- 
plied via the buffer circuits 64 to the KTP BUS 66 
associated with the microprocessor 68. Incidentally, 

5 the designation "KTP" stands for Keyboard and 
Touch Panel because keyboard inputs (from a key- 
board which is not shown) may also be supplied to 
the bus 66 along with the information from the 
touch panels. The letters "UART" which appear on 

w the buffers 64, stand for Universal Asynchronous 
Receiver Transmitters, and facilitate the handling of 
serial bytes of digital information. The BUS 66 can 
be implemented as eight or sixteen parallel wires. 
The microprocessor 68 that has been used is an 

75 Intel 8610 16-Bit H-MOS Microprocessor as de- 
scribed in the "Microprocessor and Peripheral 
Handbook", copyrighted in 1983 by Intel Corpora- 
tion. One type of UART buffer 64 that has been 
used as the Intel 8251 A Programmable Commu- 

20 nication Interface Universal 

Synchronous/Asynchronous Receiver/Transmitter 
described in the "Microprocessor and Peripheral 
Handbook" copyrighted in 1983 by Intel Corpora- 
tion. 

25 Suitable memory indicated by ROM 70 are 

provided to control the data processing sequences, 
and adequate random access memory or RAM 72 
is also provided. One ROM memory 70 that has 
been used is the Intel 2716 16K "2K by 8" U. V. 

30 Erasable PROM described in Memory Component 
Handbook copyrighted in 1983 by Intel Corpora- 
tion. One RAM memory 72 that has been used is 
the Intel 2186 "8192 by 8 bit Integrated' RAM" also 
described in the Intel Memory Component Hand- 

35 book. 

The showing of FIG. 7 is somewhat more de- 
tailed than that of FIG. 6 and indicates schemati- 
cally the mode of operation of certain circuit com- 
ponents which are shown as possibly being hard- 
40 wired, including a data shift register 74, an active 
counter 76 and a "de-active" counter 78. A shift 
register 74 which has been used is a Texas Instru- 
ments Tl 5ULS165 Parallel Load 8-Bit Shift Regis- 
ter with Complimentary Outputs described in the 
45 Memory Components Handbook copyrighted in 
1981 by Texas Instruments Company. The active 
counter 76 used is a Texas Instruments Tl 
5ULS163 Asynchronous 4-Bit Counter described in 
the Texas Instrument Memory Components Hand- 
so book. The deactive counter 76 can also be a Tl 
5ULS163 Asynchronous 4-Bit Counter. The micro- 
processor 68-1 and bus 66-1 are also shown in 
FIG. 7. FIG. 7 will be discussed in greater detail in 
connection with the sequence diagrams of FIGS. 8 
55 and 9. Of course, the sequence diagram of FIGS. 8 
and 9 can also be implemented in a computer 
program using the Intel APM-86 Assembly Lan- 
guage described in the 8086 8087 8088 Macro As- 
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sembly Language Reference Manual copyrighted in 
1980 by Intel Corporation. 

FIG. 8 is a sequence diagram indicating the 
steps which are taken by the microprocessor 68 
under the control of the read-only memory 70, and 
other instructions which may be provided by the 
host system through the input/output port 82 (see 
FIG. 6). The input/output port 82 can be the Intel 
8155H 2048 Bit Static HMOS RAM, described in 
the Intel Memory Components Handbook. The se- 
quence of operations shown in FIG. 8 is known as 
the touch panel executive sequence (TP-EXEC) 
and its start is indicated by the block 84. 

The first step in the sequence is to select 
touch panel data TP-DATA ADDR from any one of 
the buffer circuits 64 as shown in FIG. 6. This step 
is indicated by the block 86 indicating that data 
from touch panel "0" is to be selected, and of 
course, the output information is to be supplied 
back to the display unit associated with touch panel 
"0". The next step in the sequence is to initiate a 
review of touch panel "0" and determine the status 
of inputs to the touch panel to see if anyone has 
applied a finger or a pointer to the faceplate 12 of 
the display. This initiation of the search CALL TP- 
SEARCH is indicated by block 88. 

Following step 88, the next step in the se- 
quence is to determine whether any of the light 
beams which extend across the faceplate are inter- 
rupted. This is indicated in FIG. 8 by the question 
touch panel active (TP ACTIVE) diamond 90. If 
some of the beams are interrupted, the touch panel 
is active, the answer is "YES" and we proceed to 
the question indicated by the diamond 92 which 
asks whether touch panel "0" has been active 
during several successive scans or whether the 
number of times which it has been active is equal 
to or greater than a predetermined "active initial 
counf-ACTIVE 0 > ACTIVE INIT. CNT. The reason 
for this step is to avoid transient operation of the 
system if, for example, an insect or other object 
happens to interrupt the beams and give a transi- 
tory isolated interruption of one of the light beams. 
Thus, the "active" counter 76 (FIG. 7) may be 
incremented by pulses applied on lead 94 indicat- 
ing that at least one of the beams has been inter- 
rupted during a particular scan cycle. The output 
from the active counter 76 may be held in an 
output buffer within the counter and may be 
sensed or read over the bus 96. 

Accordingly, if the touch panel has not been 
active for at least the predetermined number of 
scans the answer to the question indicated in dia- 
mond 92 is "NO" whereupon the active counter 76 
would be incremented INCR (ACTIVE 0), as in- 
dicated by the block 98. In practice in the normal 
microprocessor, instead of a separate hardwired 
active counter as indicated by the block 76, the 



same function is accomplished through the use of 
a random access memory such as RAM 72 as 
shown in FIG. 6, and during successive scans, the 
number stored in a particular address in the RAM 

5 72 is withdrawn from memory incremented to the 
next higher number and inserted back into a se- 
lected random access memory location. This is 
normally all accomplished under the control of the 
program sequences in the read-only memory 70. 

w Of course, other memory could be used such as 
RAM 72 or other memories such as programable 
read only memories (PROMS) and erasable 
PROMS EPROMS. 

However, if the touch panel has been active for 

75 at least the predetermined number of scans the 
answer to the activity inquiry indicated by diamond 
92 is "YES", and then the sequence steps 102, 
104 and 106 are followed. Block 102 indicates that 
the series of steps are the sequence of operation 

20 as set forth in FIG. 9 will be called into play. More 
specifically, this involves the smoothing routine 
CALL (TP-SMOOTH) whereby the video position 
designation marker, or cursor 50, may be posi- 
tioned with much greater precision than the detect- 

25 able accuracy of the detected location of a finger 
on the faceplate of the touch panel. This will be 
described in some detail in connection with FIG. 9. 

Sequence step 104 is "CALL 
UPDATE = OUTPUT BUFFER", and this means that 

30 the new position data for the cursor 50 derived in 
accordance with the sequence of FIG. 9 is supplied 
from the touch panel data processor 26 to be 
employed by the display processor 28 to locate the 
video position designation marker, or cursor 50, on 

35 the display video screen. 

Step 106 of FIG. 8 indicates that the DE- 
ACTIVE 0 counter 78 of FIG. 7 is reset to 0. The 
de-active counter 78 is employed at the time that 
the user lifts his finger off the faceplate 12, and this 

40 counter 78 is reset to 0 at the time when the touch 
panel has been active for several successive 
scans. 

Now, returning to the TP-ACTIVE diamond 90, 
if the touch panel is not active, and no beams are 

45 interrupted, we proceed along the branching path 
extending vertically down from diamond 90 to 
block 108 which indicates that the de-active coun- 
ter 78 is to be incremented INCR (DE-ACTIVE 0). 
The next step 110 indicates that the active counter 

so 76 is to be reset to 0 ACTIVE 0=0. The diamond 
112 asks the question as to whether the de-active 
counter 78 has reached its final count DE-ACTIVE 
0 = DE-ACTIVE FINAL COUNT. In the present 
case where the scans occur approximately 30 

55 times per second, the full count for the de-active 
counter 78 might be set to "3" so that, after 
approximately one-tenth of a second of no beams 
having been interrupted, we could conclude that a 
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person's finger has been positively withdrawn from 
the faceplate- if the answer to the question posed 
by diamond 112 is "NO", then we proceed to block 
114 indicating that the same procedure will be 
followed for touch panel 1, a second touch panel 
addressed in the system TP DATA ADDRESS = 
TP DATA 1. 

However, if the de-active counter 78 has 
reached its final count (for example, 3), then the 
answer is "YES" and we proceed to sequence step 
116 designated "CALL SENT OUT ACTIVATE". 
This means that position data is selected from 
several steps back, on the basis that, as the person 
removed his finger from the faceplate, he may 
have done so at an angle and might have produced 
an undesired and erroneous input position data to 
the video display. Accordingly, by going back sev- 
eral steps prior to the first scan when the beams 
were not interrupted, an accurate pre-transient po- 
sition may be determined. 

Now, turning to FIG. 9, this sequence diagram 
relates to the obtaining of smooth and precise input 
data for positioning the video position designation 
marker or cursor from relatively coarse information 
provided by the touch panel. More specifically, in 
this regard, the successive beams might character- 
istically be spaced apart by a distance "D n which 
is one-tenth of an inch or 0.15 inch, while the 
position marker on the video screen may be lo- 
cated to an accuracy of one picture element which 
is in the order of about ten one-thousandth (0.010) 
of an inch. From an overall basis, and as devel- 
oped in detail hereinbelow, the sequence of FIG. 9 
will give the increased accuracy by combining lo- 
cation data of the finger and position data of the 
cursors from successive scans with velocity and 
acceleration corrections based on the movement 
and the rate of movement of the finger from one 
scan to the next. This additional information will 
permit very precise positioning of the cursor- 50. 

For example, when a cursor 50 is at a position 
yp cld on the display and it is desired to move the 
cursor 50 to a new position YP NEWl the finger 
placed on the touch panel faceplate 1 2 operates to 
designate the new position of the cursor 50. In the 
illustrated embodiment (FIG. 4), the vertical coordi- 
nate with the finger YF NEW is off-set below the 
desired new vertical coordinate YP NEW of the cursor 
so that the finger does not block the view of the 
cursor 50 while positioning it to the new position 

YPriEW 

Now, returning to FIG. 9. the uppermost block 
122 in this figure of the drawings is designated 
"TOUCH PANEL SMOOTH", indicating that the 
sequence of FIG. 9 is directed to providing 
smoothed location data as determined from the 
relatively coarse position input information provided 
from successive scans of the light beams across 



the faceplate. The second block 124 indicates that 
the new position, "F" of the finger both in the 
horizontal or "X" direction and in the vertical or "Y" 
direction is read and stored -READ & STORE 
5 XF New , YF NEW . Also, if this sequence is the first 
after a new active, XP O l 0 is set to XF NEW , YP 0LD is 
set to YF NEWj XV (X-velocity) is set to zero, and YV 
(Y velocity) is set to zero to cause the cursor 50 to 
establish or "jump to" the new initial position. The 
;o next step as indicated by block 126 is to calculate 
the difference AXF between the new finger location 
XF NEW and the previous position of the cursor 
XPold or the video position designation marker 50. 
In accordance with diamond 128, the next step is 

75 to determine whether the change in location of the 
pointer AXF is greater than the diodes spacing 
distance, "D", which as mentioned above, may be 
greater than one-tenth of an inch or approximately 
0.15 inch. Incidentally, the block 128 relates to 

20 positive values for the change AXF in the X posi- 
tion. Similarly, the block 130 indicates a determina- 
tion as to whether the change in pointer location 
AXF in the negative direction is less than the 
spacing -D. Now, in considering the results of the 

25 examination of the outputs from diamonds 128 and 
130, if the change is less than plus or minus D, the 
output signal is NO and we reach block 132, which 
indicates that, for the purposes of subsequent cal- 
culations, the variable "A" will be selected as 0. On 

30 the other hand, if the output signal is YES and we 
reach blocks 134 or 136, it means that the shift in 
position in the X direction had an absolute value 
which was more than the light beam spacing, and 
accordingly, the factor designated "TEMP" which 

35 is in TEMPORARY STORAGE and is employed in 
the formula in block 138 is taken as plus or minus 
D. The calculation as indicated in block 138 is then 
accomplished, and the factor A as designated in 
block 132, or as calculated in block 138 is em- 

40 ployed in calculating the velocity XV for moving the 
cursor based upon movement of the finger be- 
tween successive scans, and the new position 
XPnew of the cursor 50. 

It may be particularly noted from the two for- 

45 mulae in block 140 that the new cursor position 
Pwew is determined by using the old cursor position 
Pold. and then multiplying the velocity V^w times 
the interval between scans AT in accordance with 
the following generalized relationship which holds 

so true for both the X and the Y coordinates: 

Pnew = Pold + (V MEW • AT) 
where: 

55 

Pnew is the precise new position of the cursor: 
Pold is the precise old position of the cursor: 
determined from the prior scan: 
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V NE v/ «s the new velocity; 
AT is the time interval between scans; where " 
V NEW is a new velocity function derived from the 
old and the new cursor positions, the old and new 
pointer locations, and their coordinate and relative 
positions, locations, velocities, and accelerations 
modulated by geometrical values of damping factor 
K and gain factor G based upon the size and 
positional accuracy of the display and the touch 
panel input. 

This is, of course, the well-known formula that 
distance is equal to velocity times time. However, 
the present development is believed to be unique 
in recognizing that very fine positioning of a cursor 
is possible while maintaining positional correlation 
with the pointer from coarse input data, using posi- 
tion, and velocity and/or acceleration corrections to 
position the cursor as set forth, for example, in FIG. 
9. 

The next section of the sequence diagram of 
FIG. 9, extending from block 142 through block 
144, indicates a calculation for the Y direction 
which is substantially the same as that discussed 
hereinabove in connection with blocks 126 through 
140 relating to the X direction position and velocity 
changes. Block 146, toward the bottom of FIG. 9, 
indicates the storage of the new values for the 
position and velocity (XP NEW , YP NEW ) (XV NEW , 
YV NEW ) in both the X or horizontal direction and the 
Y or vertical direction. In addition, the block 146 
indicates the utilization of the new position data to 
reposition the cursor 50. The final block 148 in FIG. 
9 indicates a return to the main sequence of FIG. 8 
which is indicated by block 104 in the sequence 
diagram of FIG. 8. 

Summarized in examples from the viewpoint of 
a person using the touch panel, the results of 
accomplishing the FIG. 9 sequences are as follows. 
First, the smoothing equation is ignored and the 
cursor jumps to the new video position designated 
by his finger for a new touch panel activation 
resulting from his initial application of his finger to 
the faceplate. This direct cursor jump results from 
the forcing of the new initial cursor position to be 
set equal to the new initial finger positions with 
zero velocities resulting in zero velocity and 
gain/acceleration compensation calculations in the 
FIG. 9 sequence. Second, the cursor follows his 
finger movements, directly and smoothly whether 
he moves his finger slowly or rapidly across the 
faceplate. This direct cursor following of the finger 
results from selecting gain G and damping K con- 
stants such that the velocity and gain/acceleration 
compensation calculations correspond with the fin- 
ger position and movement data. For example, if 
the operator moves his finger rapidly, the distance 
between the old position and the new position, the 
velocity of the change from the old position to the 



new position and the acceleration from the the old 
position to the new position are all greater than 
they would be for slower movement, with the result 
that the cursor moves more linearly with finger 

5 position and movement of this type. Finally, these 
same gain and damping constants are also se- 
lected such that for the range of very slow and 
very small finger movements, such as when the 
finger is effectively nudging the cursor a very slight 

w distance, the velocity and gain/acceleration com- 
pensation calculations are very nonlinear with fin- 
ger movement, with the cursor indirectly moving 
very, very slowly and very, very small distances, 
but in the same direction as the person designates 

75 a precise display location. Thus, it is possible to 
nudge the cursor 50 a distance of one picture 
element even though the beam spacing is, for 
example, 10 to 15 times the dimension of a picture 
element. 

20 Incidentally, in passing, it may be noted that 

the shift register 74 in FIG. 7 indicates schemati- 
cally that new velocity and position data are en- 
tered through bus 75 toward the top of the shift 
register and that during successive scan intervals, 

25 the information is shifted downwardly so that at 
each level, older position and velocity data is avail- 
able. The bus 75 also permits the withdrawal of 
information from any desired recent past period of 
time, for example, from the next prior scan or from 

30 a scan at three or four scans previous. Access to 
any desired stage of the shift register for the entry 
or withdrawal of information is conventionally ac- 
complished through suitably addressed gates asso- 
ciated with each shift register stage. Data from the 

35 previous scan may be employed in certain of the 
calculations in order to obtain velocity data; and 
position data from a scan which took place three or 
four scans previously is employed in the imple- 
mentation of the CALL SENT OUT ACTIVATE 

40 block 116 (FIG. 8) involving the elimination of tran- 
sient errors as a person removes his finger from 
the faceplate. 

Concerning another point relative to block 124 
of FIG. 9, the position data is provided with offset 

45 information in order to accommodate for the fact 
that the person pointing toward a particular position 
on the faceplate normally has his finger offset 
slightly below the point to which he wishes the 
cursor to be located to provide a full view of the 

so desired video position and the cursor. Accordingly, 
a slight offset is provided for the X finger position, 
but not for the horizontal or Y finger position loca- 
tion. 

It may also be noted that, in cases where the 
55 input touch panel does not overlie the display, no 
offset would be needed. Thus, as mentioned 
above, if an input touch panel were available at an 
operator's desk, with a display out of reach but in 
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view, the operator could see the displayed cursor 
location when his finger is at the predetermined 
location on the input touch panel and provide oper- 
ator feedback in watching the cursor move to the 
precise desired point by moving the finger on the 5 
locai input panel. It may also be noted in passing 
that the display could be in the form of a plasma 
panel, a liquid crystal display, or arrays of light 
emitting diodes or other display techniques, instead 
of a catahode ray tube. iq 

As one further point, it has been noted that the 
cursor 50 is positioned as a calculated function of 
input location data, pointer or finger velocity data, 
and an acceleration factor, in determining the new 
cursor position. As an alternative to the use of 75 
mathematical formulae and performing the calcula- 
tions, a look-up table may be provided which would 
give values for changes in the position of the 
cursor depending on the changes in sensed input 
positions during successive scan intervals. 20 

In conclusion, it is to be understood that the 
foregoing description and the embodiments shown 
in the drawing merely represent one mode of im- 
plementation of the touch panel display system of 
the present invention. Other variations may be de- 25 
vised to accomplish the same function, through the 
use of the other sequence steps, or other logic 
hardware. As mentioned above, instead of an array 
of light beams, other types of touch panel inputs, 
such as switches or capacitive elements on a trans- 30 
parent and/or flexible plate over the display or 
remote from the display, may be employed. In 
addition, although described in connection with a 
cathode ray tube as the display technology, the 
present system is also applicable to other forms of 35 
displays which have been proposed heretofore or 
which are currently under development. Accord- 
ingly, the present invention is not limited to that 
precisely as shown in the drawings and as de- 
scribed hereinabove. 40 



Claims 

1 . A position designation system using a touch 45 
panel input comprising: 
means for providing a display; 
touch panel input means corresponding generally 
to the face of the display; 

means for periodically scanning said touch panel so 
input means to obtain position data during succes- 
sive scan intervals of time based upon the location 
of a pointer on the face plate; and 
means for compensating for touch initiation dy- 
namics by delaying any changes in the position of 55 
the cursor until the location of the pointer on touch 
panel array has been scanned for a predetermined 
pluariiity of scan intervals. 



2. A display position designation system using 
a touch panel input comprising: 

means for providing a display; 

touch panel input means corresponding generally 

to the face of said display; 

means for periodically scanning said touch panel 
display means to obtain the position data during 
successive scan intervals of time based upon the 
location of a pointer on the face plate; and 
means for eliminating cursor location termination 
transients by locating the cursor at the precise 
calculated position on said display based on at 
least one touch panel scan earlier than the final 
touch panel scan before the termination of touch 
panel pointer input indications, whereby the angular 
removal of the pointer will avoid an erroneous 
cursor position on the display. 

3. A display position designation system ac- 
cording to claims 1 and 2 comprising: 

touch panel input means correlating generally to 
the face of the said display, having a positional 
accuracy which is relatively coarse as compared 
with the predetermined positional accuracy of said 
display; 

means for periodically scanning said touch panel 
input means to obtain the coarse position data from 
a pointer during successive scan intervals of time; 
means for successively determining new precision 
cursor locations based on the prior position, the 
velocity of travel and the distance between the 
prior position and the new position; and 
means for positioning the cursor in the precise 
newly determined position on the display. 

4. A system using a coarse touch panel input 
as defined in Claim 1, 2 or 3 wherein said touch 
panel input means includes an array of light beams 
which are to be interrupted by a pointer at the 
position selected. 

5. A system using a coarse touch panel input 
as defined in Claim 1, 2 or 3 wherein said touch 
panel input means includes an array of interrup- 
tabie light beams extending across said display in 
an intersecting matrix. 

6. A system as defined in Claim 1, 2 or 3 
wherein said touch panel extends across the face 
of the display. 
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© Precision display position designation system using coarse touch panel input 



© A display includes circuitry for locating a cursor 
or similar position designation on a display which 
might, for example, represent a geographical area on 
a keyboard. A touch panel array of phototransistors 
and light emitting diodes provides a matrix of light 
beam paths across the face of the display or as a 
separate detection unit which are interrupted when a 
pointer such as a finger points to a particular loca- 
tion on the display and interrupts the light beams 
which is a coarse indication of a new cursor position. 
Initial transient position designation errors are elimi- 
nated by delaying until the array of light beams have 
been interrupted for several scan intervals at which 
2 time tne fi xed position is established or "jumped to w ; 

and terminating transient errors are eliminated by 
jN deleting the last few position indications just prior to 
gjwhen the array of beams has remained uniterrupted 
for several scan intervals. 
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